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ANOTHER  LOOK  AT  ITERATIVE  METHODS 
FOR  ELLIPTIC  DIFFERENCE  EQUATIONS 


Seymour  V.  Parter 


Michael  Steuerwalt 


ABSTRACT 


Iterative  methods  for  solving  elliptic  difference  equations  have 
received  new  attention  because  of  the  recent  advent  of  novel  computer 
architectures  and  a  growing  interest  in  three-dimensional  problems. 

The  fundamental  characteristic  of  an  iterative  method  is  its  rate  of 
convergence.  We  present  here,  in  the  context  of  the  model  problem  in 
two  and  three  dimensions,  a  very  simple  theory  for  determining  the 
rates  of  convergence  of  block  iterative  schemes.  This  theory  is  easily 
extended  to  general  domains,  general  elliptic  problems,  and  higher 
dimensions. 
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Introduction 


Some  15*20  years  ago  there  was  considerable  interest  in  iterative 
methods  for  elliptic  difference  equations  -  see  [13], [14], [18], [19], [20], 
[21], [10].  More  recently  there  has  been  a  greater  emphasis  on  direct 
methods  for  these  sparse  matrices,  as  shown  by  [6], [7], [15], [16]. 

However,  the  advent  of  new  computer  architectures  —  "vector  ma¬ 
chines"  and  "parallel  processors"  —  and  a  renewed  interest  in  three- 
dimensional  problems  make  it  desirable  to  reconsider  the  analysis  of 
iterative  methods,  as  in  [3], [8], [9], [17]. 

A  fairly  general  theory  for  estimating  the  rates  of  convergence  of 
iterative  methods  for  elliptic  difference  equations  was  developed  in  [13]. 
However,  partly  because  of  the  generality  of  that  work  (variable  coeffi¬ 
cients,  general  domains,  etc.),  it  is  by  no  means  a  transparent  discussion. 
Because  of  this,  and  the  Interest  in  a  particular  block  iterative  scheme 
(k*k  blocks),  D.  Boley,  B.  Buzbee  and  S.V.  Parter  [3]  gave  a  relatively 
direct  discussion  of  the  basic  Ideas  for  the  case  of  the  model  problem  - 
the  Poisson  equation  in  a  square.  Their  presentation  was  based  on  the 
relatively  strong  estimates  of  J.  Nitsche  and  J.C.C.  Nitsche  [12]  and 
A.  Brandt  [4]. 

In  this  report  we  give  another  variant  of  this  general  approach  to 
the  problem  of  estimating  the  rates  of  convergence.  Our  new  presentation 
avoids  the  estimates  of  [4]  and  [12].  For  the  model  problem  in  two  or 
three  dimensions  this  Is  a  small  thing.  However,  the  estimates  of  [12] 
have  never  been  extended  to  general  regions  and  cannot  hold  in  more  than 
three  dimensions.  On  the  other  hand,  the  approach  taken  here  can  easily 
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be  extended  to  general  domains,  general  elliptic  equations,  and  any  dimen 
sion.  Thus,  in  addition  to  solving  some  particular  problems  of  interest 
we  also  give  a  development  which  could  be  used  in  the  general  case. 

In  section  2  we  describe  the  model  problem  (in  two  and  three  dimen¬ 
sions).  In  section  3  we  develop  the  general  theory  for  these  model 
problems.  In  section  4  we  describe  some  particular  iterative  schemes. 
These  are: 

i)  In  two  dimensions  -  k-line  blocks  and  kxk  square  blocks, 
ii)  In  three  dimensions  -  k-plane  blocks,  kxk-line  blocks  and  kxkxk 
cubic  blocks. 

Finally,  In  section  5  we  obtain  the  spectral  radius  of  the  block 
Jacobi  scheme  associated  with  each  of  these  block  structures.  The  spec¬ 
tral  radii  of  the  associated  Gauss-Seidel  and  SOR  schemes  are  then 
determined  in  the  usual  way  (these  schemes  all  satisfy  block  property 
A-  see  [1]»[21])  from  the  formulae  (see  [1],[20],[18]) 

1.1)  PGS-PJ 

1.2)  (p^+to-1  )2  «  uxyjJ 

where  pgs,  pu  and  Pj  denote  the  spectral  radii  of  the  Gauss-Seidel, 
SOR  and  Jacobi  Iterative  schemes  respectively. 

We  are  Indebted  to  Bill  Buzbee  for  his  continued  encouragement  in 


this  work. 
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2.  The  Model  Problems 
Let 

2.1a)  3(2)  =  ((x,y);  0<x,yd}  , 

2.1b)  £2(3)  =  {(x,y,z);  0<x,y,z<l}  . 

Let  P  be  a  fixed  integer  and  set 

h  ■  m  * 

Consider  the  sets  of  Interior  mesh  points 

2.2a)  3(2,h)  =  {(x^.y^)  -  (ih.jh)}  ,  1  <  1,  j  <  P  , 

2.2b)  3(3, h)  5  {(xi,yj,zn)  *  (ih,jh,nh)}  ,  1  <  1,  j,  n  <  P  , 

as  well  as  the  boundary  mesh  points 

2.3a)  33(2, h)  =  {(x. ,yj)  «  (ih.jh;  1  or  j  *  0  or  P+1}  , 

2.3b)  33(3, h)  =  ((ih.jh.nh);  1  or  j  or  n  «  0  or  P+1}  . 
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Three-dimensional  Case:  for  1  <  i,  j  <  P 

2.4b)  (y3)U)i,j,n  *  '  2UV j  Ui-U.n 

+  "  I  2Ui,J»n  +  Ui.j-l,n  ,  Uj,j,n+1  ~  2Ui,J,n  *  Ui,J,n-1 

h2  h2 

Note:  While  U  is  to  be  defined  on  the  entire  mesh  region 
12(2, h)  u  312(2, h)  or  12(3, h)  u  312(3, h),  &h(2)  and  Ah(3)  are  defined 
only  on  the  interior  mesh  points,  12(2, h)  or  12(3, h).  Also  we  define  the 
usual  difference  operators 

2.5a)  CvxU]1,j  *  "^h - ^  »  1  £  J  i  p*  0  <  i  <  p 

U,  4*1  "  4 

2.5b)  [7  U].  ,  ■  ^  ,  0  <  j  <  P,  1  <  i  <  P. 

y  i.j  h 

In  fact,  we  will  use  the  symbols  7  ,  7  ,  7  to  designate  the  forward 

x  y  z 

divided  difference  quotients  in  the  x,  y  and  z  directions,  in  all 
dimensions.  This  usage  should  cause  no  confusion. 

The  basic  problem  is:  Given  grid  vectors  F  and  G,  and  m*2  or  3, 
find  a  grid  vector  U  such  that 

2.6a)  Ah(m)U  *  F  in  S2(m,h). 


2.6b) 


U  ■  G  on  3$2(m,h). 


-  -— . . — - —  -  -  -  -  - 
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After  an  ordering  of  the  points  (x^.y^)  or  (x^.y^.z,,)  Is  de- 

2 

termlned  we  let  A  be  the  matrix  representation  of  -h  Ah(m);  sym¬ 
bolically,  we  write 

2.7)  A--h2Ah(m). 

As  we  have  already  noted,  A^(m)  maps  vectors  with  P111  +  2mPm  ^ 
components  into  vectors  with  Pm  components.  The  matrix  A  is 
actually  a  Pm  by  P1"  matrix.  The  known  boundary  values,  G,  are  put  on 
the  right-hand-side.  In  this  way  the  difference  equations  (2.6a),  (2.6b) 
take  the  form 

2.8)  AV  *  F 

where  the  ~  over  F  is  meant  to  indicate  both  the  result  of  ordering 
the  components  of  -h2F  and  the  necessary  modifications  of  F  required 
by  the  G  terms.  In  any  case,  every  vector  V  with  Pm  components  may 
be  thought  of  as  a.  grid  vector  which  also  satisfies 

2.9)  V  *  0  on  3fl(m,h). 

An  Iterative  method  for  the  solution  of  2.8)  is  determined  by  a 
"splitting" 

2.10a)  A  «  M  -  N  . 

Equation  (2.8)  is  then 


2.10b) 


MV  -  NY  +  F  . 
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After  choosing  a  first  guess  V°,  one  obtains-  V1 ,V2,...,Vk,...  from 

2.11 )  MVk+1  -  NVk  +  F  . 

Let 

2.12)  p  •  max { j X | ;  det  (XM  -  M)  *  0}  . 

k 

It  is  well  known  that  the  iterates  V  converge  to  the  unique  solution 
V  of  (2.8),  independently  of  V°,  if  and  only  if 

2.13)  p  <  1  . 

The  first  problem  studied  in  this  report  is:  Find  the  asymptotic 
behaviour  of  p  as  h  -*■  0  . 

Remark:  Of  course,  for  every  X  which  is  a  generalized  eigenvalue 
(i.e.,  det  (XM  -  N)  »  0)  there  is  a  vector  U  /  0  such  that 


2.14) 


XMU  =  NU  . 
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3.  A  General  Approach 

We  make  some  assumptions  about  the  splitting  (2.10a). 


A.l)  M  »  M*  and  is  positive  definite. 


A. 2) 


p  a  max 
x/0 


<Nx,x> 
( Mx,x> 


where 

<x,y>  -  x'y  -  l  x(jy(J  (or  .  I  x1jnyijn)  . 


Note:  NsN*  because  A  =  A*,  and  M  =  M*;  as  is  well  known  [5], 
the  generalized  eigenvalues  are  all  real  and 


p  s  max 
xfO 


(Nx,x>l 
<Mx,x>  * 


The  force  of  the  assumption  (A. 2)  therefore  is  that  max|X|  occurs 
for  a  positive  eigenvalue  X  *  p  , 


A.3)  There  is  a  positive  constant  Nq,  independent  of  h,  such  that 

»0  • 

Here 


l|N||„  *  sup{|(NU)tj|;  lu^l  <  1}  . 

Finally  we  come  to  the  main  new  concept. 

A. 4)  There  are  positive  constants  q.  D,  independent  of  h,  such 
that  if  U  is  a  grid  vector  satisfying 


U  s  0  on  38(m,h) 
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then 

3.1)  <NU,U>  *  q<U,U>  +  E  , 
where 

3.2)  |E|  <  Dh[<U,U>  -  <AhU,U>]. 

Remark:  As  one  might  imagine,  the  determination  of  q  and  the  verifi¬ 
cation  of  (A. 4)  are  the  important  technical  aspects  of  this  analysis  when 
applied  to  any  particular  case.  However,  as  we  shall  see,  it  is  not  too 
difficult. 

Lemma  3.1:  Suppose  the  splitting  (2.10a)  satisfies  (A.l)  and  (A.2). 

Then  the  method  is  convergent,  that  is,, 

3.2)  p  <  1  . 

Proof:  Let  U  be  the  eigenvector  associated  with  p  .  Then  <NU,U>^0 
Since  M  *  A  +  N  and  A  is  positive  definite,  we  have 

n  ,  <NU,U>  .  <NU,U>  .  , 

0  -  p  (Mu!u>  <  AU,U>  +  <  NU,tJ>  1  • 

The  basic  result  of  this  section  is 

Theorem  3.1:  Suppose  the  splitting  (2.10a)  satisfies  the  conditions 
(A.l),  (A.2),  (A. 3)  and  (A.4).  Then 

p  «  1  -  22^  +  0(h3)  . 


3.3) 
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Proof:  Let  U  be  the  grid  vector 


3.4a) 


U..  =  (sin  i^h)(sin  j-rrh) ,  m  *  2  , 
•  J 


3.4b)  U.jn  =  (sin  i-rrh) (si n  j-rh)(sin  nrh),  m  *  3  . 


Then  U  *  0  on  3ft.  The  following  facts  are  well-known  (see  [18], 
particularly  page  202). 

r-nm  r  n 


m  m"1  t  o 

3.5)  hm<  U,U>  =  [±j  [p^-J  ,  m  =  2,3 


3.6) 


*  2m(l-cos  irh)  =  imr2h2[l-  ^  (uh)2  +  0(h4)] 


Furthermore,  for  all  grid  vectors  V  f  0  which  vanish  on  3fl(m,h) 
we  have  the  inequality 


3.7) 


-  <AhV,V>  1  <AV>V>  2m (1 -cos  irti)  _  2  nff2. 
TVTV5 ~2  W-  "V  +0(h) 


Because  M  *  A  +  N, 


.  <NU,U>  _  <NU,U> 
p  -  (MU.U)  <AU,U>  +  <NU,U>  - 


Applying  (A. 4)  and  (3.6)  we  have 


< NU,U>  -  q< U,U>  ♦  E 


where 


| E |  <  Dh[l+nnr2  +  0(h2)]<U,U>  . 


msa 
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Thus 


P  > 


1  + 


1 _ 

( AU.U  > 
q<U,U>  +  E 


Using  (3.6)  we  obtain 


3.8) 


p  >  1  -  +  0(h3) 


We  now  turn  to  the  proof  of  the  reverse  inequality. 

Let  U  be  the  eigenvector  associated  with  p  and  normalized 

so  that 

3.9)  hm< U,U>  *  1  . 

Then 

pMU  »  NU 

pAU  =  p(M-N)U  =  (l-p)NU  . 

Hence 


3.10a)  -Ah(m)U-  yNU 

where 

3.10b)  y  -  (l-p)/ph2 

From  lernna  3.1  and  (3.8)  we  see  that 
3.11a)  0  <  y  <  ~i+  0(h)  , 


11 


and 

2 

3.11b)  lim  sup  \s  <  nm  . 

h-*0  q 

Moreover,  the  theorem  will  be  proven  if  we  show  that 
_2 

3.12)  u  >  --  +  0(h)  . 

From  (3.10a),  (A. 3),  and  (3.11b)  we  see  that  when  h  is  sufficiently  small 

2 

3.13)  -hm<Ah(m)U,U  ><  [^-NQ]hm<U,U>  . 

But  (3.10a)  and  (A. 4)  show  that 

3.14a)  hm<-Ah(m)U,U>  *|i  [qhm(U,U>+E], 

where 

3.14b)  |E|  <  hD[hm<U,U>  -  hm<Ah(m)U,U  >]  . 

Substituting  (3.13)  into  (3.14b)  gives 

2 

3.14c)  | C |  <  h0[l  +^-  N0][hm<U,U>  ]  . 

Using  (3.7),  (3.9)  and  (3.14c)  in  (3.14a)  we  have 

-hm<  AK(m)U,U>  _  , 

— j r - ■  w[q+E]  >  m*  +  0(h) 

h^U.U) 


1 
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4.  Some  Iterative  Methods 

In  this  section  we  describe  the  basic  block  structure  associated 
with  the  iteratives  schemes  of  interest. 

Consider  a  system  of  linear  equations 

4.1)  Ax  *  y 

where  A  is  an  R*R  matrix.  A  block  Jacobi  iterative  method  for  the 
solution  of  (4.1)  is  completely  described  by  describing  the  partition 
of  the  R-vector  x  Into  blocks.  Specifically,  suppose  that  we  Imag¬ 
ine  all  R-vectors  U  partitioned  into  block  vectors  of  the  form 

4.2)  U  *  (UrU2,...UR,)t 

where  each  Is  itself  an  R^-vector.  Corresponding  to  this  partition 
of  vectors  the  matrix  A  is  naturally  partitioned  in  blocks 

A  •  (A(J) 

where  each  A^  is  Itself  a  matrix.  In  particular,  each  diagonal  block 
A^  is  a  square  R^  x  R^  matrls.  The  block  Jacobi  iterative  scheme 
associated  with  this  block  structure  Is  now  given  by 

4.3)  Ajj*j(vf1)  '  -  ■ 

In  terms  of  the  discussion  In  sections  2  and  3,  we  have  a  splitting  (2.10a) 
with 

4.4)  M  ■  diagonal  (Aj j )  . 
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The  Iterative  schemes  discussed  in  this  report  are  described  by  the 
following  block  decompositions.  Let  k  be  a  fixed  integer.  We  con¬ 
sider  the  case  where  k  divides  P,  i.e,  there  is  an  Integer  2 
such  that 

4.5)  P  *  kQ  . 

Of  course,  Q  -*■  »  as  P  »  (h-nl)  and  vice  versa. 

I.  )  Two-dimensional  Problems: 

1. )  k-1ine  iterative  scheme.  This  scheme  is  described  in  detail  in 

[13], [14],  Each  "block"  consists  of  the  unknowns  associated  with 

the  points  on  k  consecutive  horizontal  (or  vertical)  lines.  For  ex¬ 
ample,  the  s'th  block  consists  of  the  values 

4.6)  (U1J;  1<1<P,  k(s-l)  +  l  <  j<ks>  . 

2. )  kxk  block  iterative  scheme.  This  scheme  is  described  in  [3]. 

Each  block  consists  of  the  unknowns  U^-  associated  with  the  points  in 
a  kxk  square.  It  is  easiest  to  describe  this  block  with  a  double  index 
(r,s).  The  (r,s)  block  consists  of  the  values 

4.7)  {U^;  k(r-l) +  1<  1  <  kr,  k(s-l)  + 1  <  j  <  ks>  . 

II. )  Three-dimensional  Problems: 

1.)  k-plane  Iterative  scheme.  In  this  scheme  each  block  consists 
of  the  unknowns  U^n  associated  with  the  points  on  k  consecutive 
planes.  In  this  case  the  blocks  are  associated  with  a  single  index,  say  $. 


The  s'th  block  consists  of  the  values 

4.8)  *uijn;  ^-P’  +  1  in<ks}  . 

2. )  k*k-line  iterative  scheme.  In  this  scheme  each  block  con¬ 
sists  of  the  unknowns  U.jn  associated  with  the  points  on  a  kxk  square 
of  lines  in  the  (say)  z-dlrection.  In  this  case  the  blocks  carry  a 
double  index,  say  (r,s).  The  (r,s)  block  consists  of  the  values 

4.9)  *uijn;  1-n-p*  k(r-l)  +  1  <  i  <.kr,  k(s-l )  +  1  <  j  <  ks}  . 

3. )  kxkxk  block  iterative  scheme.  In  this  scheme  each  block  con¬ 
sists  of  the  unknowns  U^n  associated  with  a  kxkxk  (cubic)  block  of 

points.  In  this  case  each  block  is  associated  with  a  triple  index,  say 

(r.s.t).  The  (r,s,t)  block  consists  of  the  values 

4.10)  (Ujjn»  k(r-l)  + 1  <  i  <^kr,  k(s-l )  + 1  <.ks,  k(t-l )  +  1  <^n  <  kt} 

It  Is  tedious  but  not  difficult  to  write  the  representation  of  A, 

M  and  N  for  each  of  the  Jacobi  block  iterative  schemes  associated 
with  these  choices  of  the  block.  We  shall  give  a  unified  development  of 
these  schemes.  However,  for  the  moment,  for  illustrative  purposes,  we 
sketch  the  k-llne  scheme  1.1. 

Let  Lk  be  the  kxk  tridiagonal  matrix 

4.11a)  Lk  -  [-1,4, -l]k  . 

Let  T  be  the  kP  x  kP  block  tri diagonal  matrix 

4.11b)  T  -  C-Ik.Lk,-Ik]p  , 

where  Ik  is  the  k*k  identity  matrix. 


«*C r 
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Let  R'  be  the  kP  *  kP  matrix 


Then 

4.12a)  A  «  M-N 

where 

4.12b)  M  *  diagonal  (T)  , 

and  N  Is  the  block  trl diagonal  matrix 
4.12c)  N  »  [R.Q.R*]  . 


A  unified  approach  Is  provided  by  considering  the  1- dimensional 
operator  fT  acting  on  vectors 

4.13)  V  -  {VrV2,...Vp}t 


as  follows  for 

4.14) 


1  <_s  <_Q  -  1 ,  0  <_J  k  -  1 : 


(NV) 


»  2  <  j  <  k  -  1 

ks+1  •  i  *  0 
ks’  ^  "  1  ’ 


t 


Let  N  »N  »N  be  the  operators  which  act  on  grid  vectors  In  2  or  3 

A  JT  & 

dimensions  In  the  following  manner:  Nx  acts  on  U  only  in  the  x 
direction,  and  In  that  direction  acts  as  N.  Similarly  Ny  and  Nz 
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act  on  U  In  the  y  or  z  directions  respectively.  For  example: 
In  three  dimensions,  for  1  <  1,  j  <.  P  and  0  <  n  <  k-1. 


4.15) 


(NZU) 


i ,j,kt+n 


0,  2  <n<  k-  1 

U1,j,kt+1* 
U1,j,kt,  n *  1 


With  these  operators  It  Is  relatively  easy  to  describe  the  matrix 
N  of  the  five  splittings  described  above. 

Theorem  4.1:  Let  k  >  2.  Then 

For  the  two-dimensional  problem,  k-line  scheme: 


4.16a)  N  -  Ny 

For  the  two-dimensional  problem,  kxk  block  scheme: 


4.16b)  N  ■  N  +  N 

*  / 

For  the  three-dimensional  problem,  k-plane  scheme: 


4.17a)  N  -  Nz 

For  the  three-dimensional  problem,  kxk-line  scheme: 


4.17b)  N  *  N  +  N 

A  J 

For  the  three-dimensional  problem  kxkxk  (cubic)  block  scheme: 


4.17c)  N  *  Nx  +  Ny  +  Nz 

Proof:  The  proofs  of  these  formulae  are  given  directly  by  computation 
and  Inspection. 
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Theorem  4.2:  Let  k»l;  then  the  dominant  eigenvalue  of  the  Jacobi 
iterative  scheme  associated  with  each  of  the  above  block  schemes  is 
given  directly  by  the  theory  of  tensor  products.  They  are: 

The  two-dimensional  problem,  k-1 ine  scheme: 

4.18a)  p(l-L)  =  1  -  A2  +  0(h4)  . 

The  two-dimensional  problem,  1  *  1  block,  i.e.  "point"  scheme: 

4.18b)  p(l-B)  «  cos  h  -  1  -]•  ir2h2  +  0(h4) 

The  three-dimensional  problem,  1 -plane  scheme: 

4-'9a) 

The  three-dimensional  problem,  1x1-11ne  scheme: 

*■'*>>  ^’2-U-5^ff-.-|A2.0(h4) 

The  three-dimensional  problem,  1  x  l  x  l  block,  i.e.  "point"  scheme: 

4.19c)  p(l3-B)  ■  cosirh  *  1  -  jttV  +  0(h4) 

Proof:  These  formulae  follow  immediately  from  the  standard  tensor  product 
formulation  -  see  [10]. 
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5.  Rates  of  Convergence:  k  >  2 

In  this  section  we  consider  the  model  problem  (2.6a) ,  (2.6b). 
We  study  the  five  block  Jacobi  schemes  described  In  section  4 
(with  k  >_  2).  We  determine  the  appropriate  constants  q  and  0  so 
that  we  satisfy  (A. 4)  and  thus  may  apply  Theorem  3.1  to  obtain  the 
dominant  eigenvalues  of  these  Iterative  schemes. 

Lemma  5.1 :  Let  0  <  hk  <  1  and  let 

5.1)  V-(V1,V2,...Vp)t. 

Let  N  be  given  by  (4.14).  Then 

5.2a)  <V,NV>  -  |<V,V>  +  2e 

where 

5.2b)  |e|  <h<V,V>  +  2h<VxV,VxV>  . 

Proof:  For  every  j ,  1  <.  j  <.  k  we  have 

5.3)  vks*l  ■  Vks*J  J,  *7xv'k s+l  ’ 

5'4>  *  vks.J  '  h  X  (7xV*ksn  • 

Of  course,  the  sum  in  (5.3)  Is  empty  If  j*1  . 

I. 

K .  » 

Ik  . 


In  any  case 

5'*>  Wk,  ■  <W2  •  "WW  *  hV 

where 

|Eaii  Vuv>ks«i  • 

Summing  (5.5)  on  j  and  dividing  by  k,  we  have 


where 


Ws’f  j,(Wj)2tFEs 


lE*li2b(1i1lVkS»jl>  j/VW 


+  kh  fJ0HV>k»«l>‘ 


Thus  we  can  estimate  E$  by 


(Vks*j)  +(1  «*\l 


yv>2s«] 


Now  (5.2)  follows  from  the  form  of  N  and  summation  on 
s  *  0,1 . .Q-l  . 

We  recall  two  basic  identities. 


JJJ  IUII,  IffjjVH  -  II I 

*  '■ 


-IT 


a*' 
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Lemma  5.2:  Let  m  *  2.  Then 

5.8a)  -<U,AhU>  3  <7xU,7xU>  +  <VyU’V>  * 

Let  m  =  3.  Then 


5 -8b)  -<U,AhU>  *  <  VJ,7XU>  +  <7yU‘7yU>  +.<VzU,72U>  * 

Proof:  These  results  follow  directly  from  summation  by  parts 
(see  [1],[18]). 


Theorem  5.1 :  Consider  the  two-dimensional  block  Jacobi  iterative 
schemes  (1.1),  (1.2)  described  by  the  blocks  (4.6)  and  (4.7)  respec 
tively.  Let  p(kL)  and  p(kB)  denote  their  respective  dominant 
eigenvalues.  Then 


5.9a)  p(kL)  *  1  -  kuV  +  0(h3)  , 

5.9b)  p(kB)  -  1  -  jkA2  +  0(h3)  . 


Proof:  Because  of  Theorem  4.2  we  need  only  consider  the  case  k  >_  2  . 
From  the  block  structure  we  see  that  M  *  M*  and  is  positive  definite. 
Moreover,  block  property  A  holds  and  thus  (A. 2)  holds.  It  Is  obvious 
from  Theorem  4.1  that 

II"  II.  £  3  . 


Thus,  it  is  only  necessary  to  determine  q  and  D. 
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For  the  k-line  scheme  we  apply  Theorem  4.1,  specifically  (4.16a). 
Applying  lemma  5.1  we  have 

<U,NU>  =  |<U,U>  +  E 

where 

|E|  <  2h[< V,V>  +  <VyV,VyV>]  . 

Using  (5.8a)  we  have 

q  *  ,  D  «  2  ,  m  a  2 

and  (5.9a)  follows  at  once. 

For  the  kxk  block  scheme  we  obtain 

4 

q  *  £•  ,  0*2,  m  *  2 
and  (5.9b)  follows. 

Theorem  5.2:  Consider  the  three-dimensional  block  Jacobi  schemes  (II. 1), 
(II. 2)  and  (II. 3)  described  by  the  blocks  (4.8),  (4.9)  and  (4.10)  respec- 
tlvely.  Let  p(kP),  p(k  L)  and  p(k  B)  denote  their  respective  dominant 
eigenvalues.  Then 

5.10a)  p(kP)  *  1  -  |  kirV  +  0(h3)  , 

5.10b)  p(k2l)  -  1  -  f  kir2h2  +  0(h3)  , 

5.10c)  p(k3B)  *  1  -  +  0(h3)  . 


Proof:  The  argument  uses  Theorem  4.1  and  Theorem  3.1  and  is  like  that 
given  for  the  proof  of  Theorem  5.1. 


24 


REFERENCES 

[1]  Arms,  R.  J.,  Gates,  L.  D.,  and  3.  Zondek,  A  method  of  block 
iteration,  J.  SIAM  4  (1956),  220-229. 

[2]  Aziz,  A.  K.  and  B.  E.  Hubbard,  Bounds  for  the  solution  of  the 
Sturm-Liouville  problem  with  applications  to  finite  difference 
methods,  SIAM  12  (1964),  163-178. 

[3]  Boley,  D.  L.,  Buzbee,  B.  L. ,  and  S.  V.  Parter,  On  block  relax¬ 
ation  techniques.  University  of  Wisconsin  MRC  report  #1860 
(June  1978).  Also,  Proceedings  of  the  1978  Army  Numerical  Analy¬ 
sis  and  Computers  Conference  -  ARO  Report  78-3,  277-295. 

[4]  Brandt,  Achi,  Estimates  for  difference  quotients  of  solutions  and 
of  Poisson  type  difference  equations.  Math.  Comp.  20  (1966), 
473-499. 

[5]  Franklin,  J.  L.,  Matrix  Theory,  Prentice-Hall,  Englewood  Cliffs, 

NJ  (1968). 

[6]  George,  Alan,  Nested  dissection  of  a  regular  finite  element  mesh, 
SINUM  10  (1973),  345-363. 

[7]  _ ,  Numerical  experiments  using  dissection  to  solve 

n  by  n  grid  problems,  SINUM  14  (1977),  161-179. 

[8]  Grosch,  C.  E.,  Poisson  Solvers  on  a  Large  Array  Computer,  Pro¬ 
ceedings  of  the  1978  LASL  Workshop  on  Vector  and  Parallel  Processors 
Los  Alamos  Scientific  Laboratory,  Los  Alamos,  New  Mexico  (1978), 
93-132. 


[9]  Kasic,  M.  J.,  Jr.,  A  Direct  Poisson  Solver  on  Star,  Proceedings 
of  the  1978  LASL  Workshop  on  Vector  and  Parallel  Processors. 

Los  Alamos  Scientific  Laboratory,  Los  Alamos.,  New  Mexico  (1978), 
137-164. 

[10]  Keller,  H. ,  On  some  iterative  methods  for  solving  elliptic  differ¬ 
ence  equations.  Quart.  Appl .  Math.  16  (1958),  209-226. 

[11]  Lees,  M.,  Discrete  Methods  for  Nonlinear  Two-Point  Boundary  Value 
Problems,  Numerical  Solution  of  Partial  Differential  Equations, 

James  H.  Bramble,  editor.  Academic  Press,  New  York  (1966),  59-72. 

[12]  Nitsche,  J.  and  J.  C.  C.  Nitsche,  Error  estimates  for  the  numerical 
solution  of  elliptic  difference  equations,  Archive  for  Rat.  Mech. 
and  Anal .  (1960),  293-306. 

[13]  Parter,  S.  V.,  On  estimating  the  'Rates  of  Convergence’  of  iterative 
methods  for  elliptic  difference  equations,  Trans.  Amer.  Math.  Soc. 
114  (1965),  320-354. 

[14]  _ ,  Multi-line  Iterative  methods  for  elliptic  difference 

equations  and  fundamental  frequencies,  Numerische  Math.  3  (1961), 
305-319. 

[15]  Rose,  D.  J.,  A  graph-theoretic  study  of  the  numerical  solution  of 
sparse  positive  definite  systems  of  linear  equations.  Graph  Theory 
and  Computing,  R.  C.  Read,  editor,  Academic  Press,  New  York  (1972). 

[16]  Rose,  0.  J.  and  R.  A.  Willoughby,  editors,  Sparse  Matrices  and 
their  Applications,  Plenum  Press,  New  York  (1972). 


26 


[17]  Sameh,  A.  H.,  Chen,  S.  C.,  and  D.  J.  Kuc-k,  Parallel  Poisson 
and  Biharmonic  Solvers,  Computing  17  (1976),  219-230. 

[18]  Varga,  R.  S.,  Factorization  and  normalized  iterative  methods. 
Boundary  Problems  in  Differential  Equations,  R.  E.  Langer,  editor, 
Univ.  of  Wisconsin  Press  (1960),  121-142. 

[19]  _ ,  Matrix  Iterative  Analysis,  Prentice^Hall ,  Englewood 

Cliffs,  flJ  (1962). 

[20]  Young,  David  M. ,  Iterative  Solution  of  Large  Linear  Systems, 

Academic  Press,  New  York  (1971). 

[21]  _ ,  Iterative  methods  for  solving  partial  difference  equa¬ 

tions  of  elliptic  type,  Trans.  Amer.  Math.  Soc.  76  (1954),  92-111. 


